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AUTOMATED PART SORTING SYSTEM 
[0001] This application is a continuation of U.S. Patent Application Serial No. 09/597,946, 

entitled "AUTOMATED PART SORTING SYSTEM," by Ernest K. Kenneway et al., filed.on 
June 20, 2000, the disclosure of which is hereby incorporated by reference herein in its 
entirety. 

BACKGROUND OF THE INVENTION 

[0002] The present invention is directed to a part sorting system and, more particularly, to a 

part sorting system for automatically inspecting a plurality of uninspected parts. 

[0003] Machine vision systems have been applied in a variety of applications, which include 

food processing, metal recycling, mineral processing and paper recycling, among others. As is 
well known to one of ordinary skill in the art, vision systems are based on non-contact 
measurements of electromagnetic radiation (e.g., visible light, infrared light and x-rays), which 
are typically facilitated by a camera. In the manufacturing and processing environments, it is 
common to optically inspect and sort individual articles with automatic inspection systems. 
Many of the inspection systems have determined properties (e.g., color, size and shape) of the 
articles such that defective articles could be separated from good articles. 

[0004] Machine vision systems have been utilized, for example, to inspect fruit, vegetables and 

nuts. Machine vision systems have also been utilized in other areas that require a similar 
sorting of products and/or articles. For example, such systems have been utilized to sort wood 
chips, aggregates and manufactured products, such as, fasteners and formed parts, in addition 
to meat products, such as quartered or cubed poultry or beef products. 

[0005] In a typical system, video images of the products and/or articles are captured, with a 

camera and a frame grabber, to extract color, shape and/or size related information. 
Typically, bulk articles are stabilized, using centrifiigal force, and conveyed individually past 
an optical inspection station. In a typical prior art system that implements air deflectors, the 
center of a defective product is computed such that an air stream is aimed at the center of the 
product to remove the defective product from a product stream. 



[0006] Inspection systems have also been designed to inspect various circular parts by 

dimension and to detect surface defects in the parts. Some of these systems have determined 
an inside diameter (I.D.), an outside diameter (O.D.) and detected surface defects, such as 
nicks, fractures, etc. A wide variety of cameras, which include line scan cameras, area scan 
cameras and CMOS cameras, have been utilized or proposed for utilization in various 
inspection systems. Images captured by the cameras are automatically processed and evaluated 
such that image dependent decisions can be implemented. Typically, prior art systems have 
performed image capturing on a conveyor belt. Unfortunately, such systems must contend 
with accumulation of trash on the conveyor belt, thus complicating captured image analysis. 
Most prior art inspection systems have singulated objects for inspection, which has required 
additional tooling and has added additional costs to the system. 

[0007] Thus, an inspection system that performs off-belt inspection and does not require article 

singulation is desirable. 

SUMMARY OF THE INVENTION 

[0008] The present invention is directed to a part sorting system for automatically inspecting a 
plurality of uninspected parts. The system sorts acceptable parts from defective parts and 
includes a feed conveyor, a sorting camera, at least one rejection valve and a computer system 
that includes a processor. The feed conveyor receives a plurality of uninspected parts and 
distributes and moves the uninspected parts through an inspection area. The sorting camera 
captures an image of each of the plurality of inspected parts as the plurality of uninspected 
parts move through the inspection area. The rejection valve functions to redirect a defective 
part such that the defective part is separated from inspected acceptable parts. The processor is 
coupled to the feed conveyor, the sorting camera, and the at least one rejection valve. The 
processor, executing an inspection routine, controls the speed of the conveyor, the scanning 
rate of the sorting camera and the at least one rejection valve. The processor, executing the 
inspection routine, also compares at least one edge of a captured image to at least one stored 
template image to determine whether an inspected part is defective. 

[0009] In another embodiment of the present invention, a vibratory conveyor distributes the 

plurality of uninspected parts in a substantially even manner across a top surface of a platform 
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of the vibratory conveyor and provides the plurality of uninspected parts to the feed conveyor. 
In yet another embodiment, the top surface of the platform is made of a metal that is 
substantially covered with a material. The material serves to increase the energy absorption 
and surface friction of the top surface of the platform such that the plurality of uninspected 
parts are retained on the vibratory conveyor. In still another embodiment of the present 
invention, the vibratory conveyor includes a plurality of resilient fiberglass legs and an air 
cylinder. The plurality of resilient fiberglass legs are mechanically coupled to and support a 
bottom surface of the platform. The air cylinder is mechanically coupled to the bottom surface 
of the platform and is capable of varying the magnitude and frequency of the vibration of the 
vibratory conveyor responsive to the processor. 
[0010] These and other features, advantages and objects of the present invention will be further 

understood and appreciated by those skilled in the art by reference to the following 
specification, claims, and appended drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[00111 In the drawings: 

[0012] Fig. 1 is a simplified diagram of a part sorting system, according to an embodiment of 

the present invention; 

[0013] Fig. 2 is a block diagram of the major components of the part sorting system of Fig. 1; 

[0014] Fig. 3 illustrates a part training routine, according to an embodiment of the present 

invention; 

[0015] Fig. 4 is a diagram illustrating the capturing and comparison of an image of a part at a 

non-zero degree orientation whose edge pixels are compared to the templates of Fig. 3; and 

[0016] Fig. 5 is a flowchart of an image processing routine that determines whether a given 

part is defective. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
[0017] The present invention is directed to a part sorting system that is capable of sorting 

objects of various shapes (e.g., round and non-round parts). The part sortmg system is 
capable of separating foreign material, mixed parts, damaged parts and any other non- 
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conforming parts from the product stream. For example, the part sorting system can measure 
the outside diameter (O.D.) and inside diameter (LD.) of a round washer (e.g., one-half inch 
I.D.). In addition, the part sorting system is capable of performing one-hundred percent size 
inspection at a rate of approximately 1.2 million washers per ten hours (two thousand pieces 
per minute). The part sorting system uses a template image matching technique to sort 
defective parts by size and shape. The template image matching technique compares captured 
part unages of a plurality of uninspected parts that may be at random orientations, with at least 
one trained stored image template of a good part. Out-of-tolerance parts are indicated by size 
and shape deviation. The present technique is applicable to round and non-round objects of 
virtually any shape. One of ordinary skill in the art will readily appreciate that the system can 
be scaled to handle parts of virtually any size. 
[0018] Preferably, a line scan camera is utilized to capture a one-dimensional array of pixels of 

multiple sections of each of the plurality of uninspected parts. As is well known to one of 
ordinary skill in the art, to build an image with a line scan camera, either the camera or the 
object being inspected must move. An advantage of utilizing a line scan camera is that it 
advantageously allows for the image capturing of continuously moving objects on a production 
line. A typical line scan camera has a programmable scan rate, which allows for high 
precision inspection. 

[0019] The present invention advantageously performs off-belt inspection such that an object 

being inspected is backlit. Backlighting the object allows the line scan camera to capture a 
better image of the part. As such, the resolution (i.e., the number of gray scales that can be 
determined) is typically increased, which allows fractures in the part to be more readily 
detected. Further, image capture is enhanced as trash contamination of the captured image, 
associated with on-belt inspection, is avoided. In a typical system, a hopper provides parts at a 
controlled rate to a platform of a vibratory conveyor. The vibratory conveyor functions to 
distribute the parts evenly across a top surface of the platform, so as to typically provide a 
single layer of single profile parts. Utilizing the system, described herein, is advantageous in 
that there is no need for special tooling to align the parts in single file. A system, according to 
the present invention, provides flexibility in that the parts that can be inspected, by the system, 
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can vary in size and shape. Additionally, the automated part sorter, described herein, can 
advantageously handle parts at random orientations. 

[0020] The vibratory conveyor provides the plurality of uninspected parts to a feed conveyor 

that provides part separation and moves the parts through an inspection area, where the line 
scan camera (or cameras) scan the parts to grab images of the parts. Those part images are 
analyzed by processor controlled template image matching to sort defective parts by size and 
shape. The processor makes decision-based inspections and typically saves the inspection data 
such that it can be further evaluated, when off-line analysis is desired. Acceptable parts 
continue in the product stream while unacceptable parts are removed from the product stream. 
In a preferred embodiment, a standard personal computer system, executing a Windows NT® 
operating system, is utilized. The system is expandable in that other cameras (e.g., line scan, 
area scan or CMOS) and vision processing boards can be added to the system, to increase the 
resolution and through-put of the part sorting system, if desired. Preferably, the system 
includes a modem, which enables remote access for technical training, trouble shooting and 
upgrading of the part sorting system. 

[0021] Turning to Fig. 1, a part sorting system 100, according to an embodiment of the 

present invention, is shown. Initially, uninspected parts are supplied to the part sorting system 
100 by loading the parts into a bin 104 of a hopper 102. The parts are supplied to a vibratory 
conveyor 110 via a hopper conveyor 106, which is driven by a hopper motor 108 that is under 
processor 202 (Fig. 2) control. Vibratory conveyor 110 includes a platform 121 that has a top 
surface 120 and a bottom surface 114. In a preferred embodiment, the top surface 120 of 
vibratory conveyor 110 includes a material 122. The material 122 serves to increase the 
energy absorption and surface friction of the top surface 120 of the vibratory conveyor 110. A 
suitable material 120 is manufactured and made commercially available by Great Lakes Belting 
(Part No. FNVIOOTG). The thickness of material 120 (preferably made of nitrile) is part 
dependent. 

[0022] Attached to the bottom surface 114, of platform 121, is one end of each of a plurality of 

legs (e.g., fiberglass) 112 that support platform 121 and are mechanically coupled to the 
bottom surface 114, of platform 121. An opposite end of the plurality of legs 112 is coupled to 
a support structure 123. One end of an m cylinder 116 is mechanically coupled to the bottom 



5 



surface 114 of platform 121. An opposite end of the air cylinder 116 is coupled to the support 
structure 123. 

[0023] A suitable air cylinder 116 is manufactured and made commercially available by Martin 

Engineering (Part No. 32505). Air cylinder 116, under processor 202 control, varies the 
magnitude and frequency of the vibration of the vibratory conveyor 110 such that the parts are 
normally separated into a single layer. The vibration of the vibratory conveyor 110 causes the 
parts to move across the top surface 120 of the platform 121 in the direction of feed conveyor 
130. Processor 202, of system 100, optimally controls the vibration of vibratory conveyor 122 
such that parts of different size and weight can be sorted with part sorting system 100. 
Commercially available vibratory conveyors have not allowed the frequency and amplitude of 
the vibration to be part optimized and thus, cannot be utilized for a wide variety of parts. 

[0024] Feed conveyor 130 includes a feed conveyor motor 132 for driving a conveyor belt (not 

shown), of feed conveyor 130. Feed conveyor motor 132 includes an encoder (not shown) that 
provides signals to processor 202 such that processor 202 can determine the speed of the belt 
and, in turn, the speed of the parts across the feed conveyor 130. Feed conveyor 130 delivers 
the plurality of uninspected parts to an inspection area defined by camera 140 and rejection 
valve 144. As conveyor 130 moves the plurality of uninspected parts into the inspection area, 
camera 140, under processor 202 control, captures images of the mdividual uninspected parts. 
The capturing of images is facilitated by a backlight 142. The illumination provided by 
backlight 142 can be derived, for example, from a light emitting diode (LED) or a fluorescent 
light source. The backlight 142 allows camera 140 to capture images with sharper contrast, 
which enables systems 100 to detect, for example, fractures in the face of a part. 

[0025] Preferably, an air stream is provided across backlight 142 such that backlight 142 

remains free of various trash (e.g., dirt, oil, etc.) that typically comes off the conveyor belt. 
Preferably, a clean-in-place (CIP) air knife is applied to the belt of feed conveyor 132 such that 
trash is removed. As previously stated, aligning parts on a track or on multiple tracks limits 
the ability of a given part sorting system to handle a wide variety of parts. In a preferred 
embodiment, backlight 142 includes a plurality of optical fibers that provide backlighting, of 
the uninspected parts, for camera 140. A suitable camera is manufactured and made 
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commercially available by Easier (Part No. LIGD). A suitable backlight is manufactured and 
made commercially available by Illumination Technology (Part No. 3900). 

[0026] Upon capturing an image of each part, the image is analyzed by processor 202. 

Processor 202 executes image processing software which compares the captured image to at 
least one template image to determine whether a part is defective. As will be further described 
below, when a defective part is detected, processor 202 causes one or more air valves located 
within rejection valve 144 to be actuated. Utilizing multiple air valves within rejection valve 
144 allows multiple parts that are side-by-side to be inspected at the same time and allows a 
good part that is adjacent to a defective part to remain in the product stream when a defective 
part is removed from the product stream. A suitable rejection valve is manufactured and made 
commercially available by MAC (Part No. 52). 

[0027] Preferably, a processing thread of the inspection software causes system 100 to 

continuously grab and process images of parts, while system 100 is active. This is facilitated 
through the use of multiple buffers, which allow processing of one image while live grabbing 
of a second image. The software calculates the time at which a given defective part can.be 
acted upon by an appropriate air valve, within rejection valve 144, and activates the 
appropriate air valve or valves at that time. One of ordinary skill in the art will appreciate 
that, the time is dependent upon the speed of the belt of the feed conveyor 130 and the 
positioning of the rejection valve 144 with respect to the inspection end of feed conveyor 130. 
One of ordinary skill in the art will also appreciate that the appropriate air valve, of rejection 
valve 144, is typically determined by the location of the part on the conveyor belt. Actuating 
an appropriate air valve, of rejection valve 144, causes the defective part to be deflected into a 
reject chute 146. Good parts pass from feed conveyor 130 to take-away conveyor 150 
undisturbed by rejection valve 144. 

[0028] Take-away conveyor 150 provides inspected good parts through a part counting area, 

defined by part counting camera 160. A part counting backlight 162 provides backlight 
illumination to the parts for easier detection by part counting camera 160. Part counting 
camera 160 is also coupled to processor 202 such that processor 202 can determine when a 
packaging box 184A, 184B or 184C, located on packaging box conveyor 180, contains a 
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desired number of parts. At that point, processor 202 causes a top gate actuator 166 and a 
bottom gate 168 to move a top gate 167 and a bottom gate 169 to a closed position. 

[0029] Under processor 202 control, packaging valve 164 deflects the good parts into a bottom 

chute 172. Processor 202 then actuates a packaging box conveyor motor 182 such that a new 
empty packaging box 184B is delivered beneath bottom chute 172 and top chute 170 such that 
it can receive good parts. Upon positioning a new box 184B to receive parts from the bottom 
chute 172 and the top chute 170, processor 202 opens top gate 166 and bottom gate 172 such 
that the held good parts are delivered into the packaging box 184B. In this manner, good parts 
are retained in bottom chute 172 while the new packaging box 184B is moved into position. 
This process is repeated when the new packaging box 184B receives the desired number of 
parts. Thus, a part sorting system has been described, which allows a wide variety of parts to 
be automatically inspected, sorted and packaged. 

[0030] Fig. 2 illustrates a block diagram of most of the major electrical/electro-mechanical 

components of the part sorting system 100 of Fig. 1. As previously discussed, processor 202 
is coupled to a top gate actuator 166 and a bottom actuator 168 such that it controls the opening 
and closing of the top gate 167 and bottom gate 169. Processor 202 is also coupled to a 
hopper motor 108, a vibratory conveyor air cylinder 116, a feed conveyor motor 132, a take- 
away conveyor motor 152 and a packaging box conveyor 182. Processor 202 provides control 
signals to motors 108, 132, 152 and 192 and receives signals from encoders located within 
motors 108, 132, 152 and 192 that allow processor 202 to determine if the motors 108, 132, 
152 and 182 have responded appropriately. For example, processor 202 receives signals from 
the encoder of feed conveyor motor 132, which allow processor 202 to synchronize the 
operation of the part sorting camera 140 with the speed of the feed conveyor motor 132. 

[0031] Processor 202 is also coupled to and controls rejection valve 144 and packaging valve 

164. An air source 208 provides pressurized air to the top gate actuator 166, bottom gate 
actuator 168, rejection valve 144 and the packaging valve 164. Processor 202 is also coupled 
to a display 206, which is preferably a touch screen display, and to a memory subsystem 204. 
Memory subsystem 204 includes an application appropriate amount of volatile and non-volatile 
memory. Processor 202 is coupled to part sorting backlight 142 and part counting backlight 
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162 and desirably controls the illumination provided by the backlights 142 and 162 so as to 
optimize the image capturing of part sorting camera 140 and part counting camera 160. 

[0032] Processor 202 is also coupled to a height sensor 135, which provides a rough indication 

of the height of a given individual part. Height sensor 135 allows system 100 to determine 
when multiple parts are stuck together and is preferably a laser through beam sensor 
manufactured and made conmierciaily available by SUNX (Part No. LAS 11). One of ordinary 
skill in the art will appreciate that an overhead image of two parts that are stuck together may 
not cause the parts to be rejected, as a defective part, without a rough height indicator. Thus, 
by making a rough height determination, such an anomaly can be detected. One of ordinary 
skill in the art will also appreciate that, if desired, another camera (e.g., line scan) can be 
positioned and coupled to processor 202 to determine the height of the parts more precisely. 

[0033] Fig. 3 illustrates a part training routine that allows system 100 to develop template 

images of good parts. A number of good parts 302 (e.g., four to six parts) are run through the 
part sorting system 100 such that templates 304A, 304B, 304C and 304D are generated. 
Depending on the shape of the part, one, two, or four templates may be required. For 
example, a round part only requires one template since it is symmetrical. As shown in Fig. 3, 
four templates 304 A, 304B, 304C and 304D are required for part 302. One of ordinary skill 
in the art will appreciate that the number of templates required is dependent upon how the 
software orients a given part. The software utilized by system 100 preferably rotates a 
captured part image to zero degrees and then utilizes the pixels on the edge of the part to 
determine whether the part is defective. 

[0034] As illustrated in Fig. 4, an image of a part 302A, at a non-zero degree orientation, is 

captured. To facilitate comparison, the edge pixels of part 302A are rotated to a zero degree 
orientation and compared with each of the templates 304A, 304B, 304C and 304D, as 
required. As shown in Fig. 4, the edge pixels of image 302A match template 304A. In 
determining whether a given part is defective, the image of the part is compared to one or 
more of the templates and the number of the pixels outside each template are counted. If a 
given part matches at least one template within defined limits, it is a good part. Otherwise, if a 
given part does not match any template within the defined limits, it is a defective part. It is 
advantageous to only compare the edge pixels in that the amount of time required for 
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processing the edge pixels is typically appreciably lower (part dependent) than that of 
processing all part pixels. 

[0035] Fig. 5 shows a flowchart of an image processing routine 500, executed by processor 

202, that determines whether a given part is defective. In step 502, routine 500 is initiated. 
Next, in step 504, a part image that has been buffered is retrieved from a memory buffer. 
Then, in step 506, the part image is oriented. Next, in step 508, the retrieved part rniage is 
compared to at least one stored template of a known good part. Then, in decision step 510, 
processor 202 determines whether the part is good. If so, control transfers to step 514. 
Otherwise, control transfers to step 512. In step 514, processor 202 allows the part to remain 
in the product stream and control returns to step 504. In step 512, processor 202 causes the 
defective part to be removed from the product stream at which point control transfers to step 
504. As mentioned above, processor 202 causes a defective part to be removed from the 
product stream by actuating an appropriate portion of rejection valve 144 at an appropriate 
time. 

[0036] The above description is considered that of the preferred embodiments only. 
Modification of the invention will occur to those skilled in the art and to those who make or 
use the invention. Therefore, it is understood that the embodiments shown in the drawings and 
described above are merely for illustrative purposes and not intended to limit the scope of the 
invention, which is defined by the following claims as interpreted according to the principles of 
patent law, including the Doctrine of Equivalents. 
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